Building “Stuff”?
Charles F. Vardeman II
Center for Research Computing, University of Notre Dame
2023-09-05
Building Stuff?
Building Agents based on Large Language Models!
Building “Stuff”…
Learn More: Effective testing for machine learning systems
Youtube Discussion: MLOps Chat: How Should We Test ML Models? with Data Scientist Jeremy Jordan
Building “Stuff”…
Learn More: Effective testing for machine learning systems
You are here ⬇️
What Kind of LLM Agents are we trying to build?
- Conversational Agents
- vs. Cognitive Autonomous Agents
- vs. Agents tuned for a Data Processing Task
We will focus on Conversational Agents…
The Best Advice we can Give
Caveat: You are at the Edge of Research and Practice!
Instruction Prompts
Reasoning Prompts
We want Large Language Models to be Factual!
- “Fine Tuning”
- Retrieval Augmented Generation (RAG)
We want Large Language Models to be Factual!
- Fine-Tuning: augment the behavior of the model
- Retrieval: introduce new knowledge to the model
- Retreval Aware Training (RAT) Fine-tune the model to use or ignore retrieved content
“Big Models” vs “Small Models”
Open Source Community
Matt Bronstein and Rajko Radovanovic, “Supporting the Open Source AI Community,” Andreessen Horowitz, Aug. 30, 2023.
https://a16z.com/2023/08/30/supporting-the-open-source-ai-community/ (accessed Sep. 03, 2023).
